A Space-Time Depth Super-Resolution Scheme for 3D Face Scanning

Current 3D imaging solutions are often based on rather specialized and complex sensors, such as structured light camera/projector systems, and require explicit user cooperation for 3D face scanning under more or less controlled lighting conditions. In this paper, we propose a cost effective 3D acquisition solution with a 3D space-time superresolution scheme, using a calibrated stereo rig coupled with a non calibrated projector device, which is particularly suited to 3D face scanning, i.e. rapid, easily movable and robust to ambient lighting conditions. The proposed solution is a hybrid stereovision and phase-shifting approach, using two shifted patterns and a texture image, which not only takes advantage of the assets of stereovision and structured light but also overcomes their weaknesses. The super-resolution scheme corrects the 3D information and completes the 3D scanned view despite the presence of small non-rigid deformations as facial expressions. The preliminary experimental results further validated the effectiveness of the proposed